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Overview 



Community colleges are often hailed as open-access institutions, and, arguably, no state has done 
more to ensure access than California. Unfortunately, community college completion rates are 
dismally low, in part because many students are underprepared for college-level work. In fact, tens of 
thousands of students in California are on probation, owing to poor grades or inadequate academic 
progress, or both, and face a high risk of not graduating. To date, little research has been done on how 
to help such students get back into good standing. 

As part of MDRC’s multisite Opening Doors demonstration, Chaffey College, a large community 
college in Southern California, ran two versions of a program that was designed to improve outcomes 
among students who are on probation. Both versions offered a “College Success” course, taught by a 
college counselor, which provided basic information on study skills and the requirements of college. 
As part of the course, students were expected to visit the college’s “Success Centers” — which were 
established at Chaffey in response to the school’s recognition that many of its entering students were 
not prepared for college-level work, and where students could receive supplementary individualized or 
group instruction in math, reading, and writing. The original program, called “Opening Doors,” was a 
one-semester, voluntary program. The other version, called “Enhanced Opening Doors” in this report, 
was a two-semester program, in which students were told that they were required to take the College 
Success course. 

MDRC collaborated with the college to evaluate Opening Doors and Enhanced Opening Doors. In 
2005, students were randomly assigned either to a program group that was eligible for Opening Doors 
or to a control group that received standard college courses and services. Any subsequent substantial 
differences between the program and control groups’ academic outcomes can be attributed to Opening 
Doors. In 2006, a second group of students was randomly assigned to estimate the impacts of Enhanced 
Opening Doors. This report describes the findings for both programs, which include the following: 

• Chaffey’s original, voluntary Opening Doors program did not meaningfully affect 
students’ academic outcomes. Program group students were no more likely to get off 
probation than were control group students. 

• In contrast, the Enhanced Opening Doors program, with its message of required 
participation, improved students’ academic outcomes. It increased the average number 
of credits earned, the proportion of students who earned a grade point average of 2.0 or 
higher, and the proportion who moved off probation. 

• Analyses suggest that the greater success of Enhanced Opening Doors might have 
been driven by the higher rate of participation in the College Success course. Only 
about half the original Opening Doors program group took the College Success course, 
compared with approximately three-fourths of the Enhanced Opening Doors program 
group. 

Following the study, Chaffey committed to institutionalizing a revised version of Enhanced Opening 
Doors to more fully implement and enforce the college’s probation and dismissal policies, and built 
upon its experiences in the Opening Doors demonstration to develop a voluntary program, called 
“Smart Start,” for new students who are at risk of experiencing difficulties. 

iii 



Contents 



Overview iii 

List of Tables, Figures, and Boxes vii 

Preface xi 

Acknowledgments xiii 

Executive Summary ES-1 

Chapter 

1 Introduction 1 

Overview of the Opening Doors Demonstration and Evaluation 2 

The Chaffey College Environment and Its Original Opening Doors and 

Enhanced Opening Doors Programs 3 

The Research Design at Chaffey College 1 0 

A Brief Review of Prior Research 1 0 

Contents of This Report 12 

2 Sample Intake, Sample Characteristics, and Data Sources 13 

Identifying, Recruiting, and Randomly Assigning Students 1 3 

Characteristics of the Sample 16 

Data Sources and Follow-Up Periods 21 

3 Implementation of the Original Opening Doors Program and the 

Enhanced Opening Doors Program 25 

Implementation of the Original Opening Doors Program 26 

Implementation of the Enhanced Opening Doors Program 3 1 

Differences Between the Program Environment and the 

Control Group Environment 37 

Students’ Experiences in the Original Opening Doors Program 

and the Control Environment 38 

4 Effects of the Original Opening Doors Program 45 

Effects on Educational Outcomes During the Program Semester 45 

Effects on Educational Outcomes After the Program Semester 50 

Effects for Selected Subgroups 52 

Effects on Selected Social, Psychological, and Health Outcomes 52 



v 



5 Effects of the Enhanced Opening Doors Program 55 

Effects on Educational Outcomes During the Two Program Semesters 56 

Effects for Selected Subgroups 63 

6 Summary and Conclusions 67 

Effects on Educational Outcomes 67 

What Might Explain the Programs’ Different Effects? 72 

Chaffey’s Institutionalization of Enhanced Opening Doors 74 

Appendixes 

A Supplementary Tables for Chapter 2 77 

B Survey Response Analysis 85 

C Description of Scales Presented in Chapter 3 95 

D Supplementary Tables for Chapter 4 101 

E Description of Scales Presented in Chapter 4 127 

F Supplementary Tables for Chapter 5 135 

G Supplementary Tables for Chapter 6 155 

References 167 



vi 



List of Tables, Figures, and Boxes 



Table 

ES. 1 Opening Doors Program, Enhanced Opening 

Doors Program, and Regular College Environment for 

Probationary Students: Comparison of Key Features ES-5 

2. 1 Selected Characteristics of Sample Members at Baseline: Opening Doors 

Program and Enhanced Opening Doors Program 1 7 

2.2 Probation Status of Sample Members at Baseline: Opening Doors Program and 

Enhanced Opening Doors Program 20 

2.3 Selected Characteristics of Student Body and Research Sample: Opening Doors 

Program and Enhanced Opening Doors Program 22 

3. 1 Original Opening Doors Program, Enhanced 

Opening Doors Program, and Regular College Environment 

for Probationary Students: Comparison of Key Features 33 

3.2 Receipt of Student Services: Opening Doors Program 38 

3.3 Classroom and College Experiences of Sample Members: Opening Doors 

Program 4 1 

4. 1 Program Participation: Opening Doors Program 46 

4.2 Transcript Outcomes, Program Semester: Opening Doors Program 48 

4.3 Cumulative Outcomes, Program Semester Through Third Postprogram 

Semester: Opening Doors Program 5 1 

4.4 Probation Status, Program Semester Through Third Postprogram Semester: 

Opening Doors Program 53 

5. 1 Program Participation, First and Second Program Semesters: E nh anced 

Opening Doors Program 57 

5.2 Transcript Outcomes, First and Second Program Semesters: Enhanced 

Opening Doors Program 59 

5.3 Cumulative Outcomes, First and Second Program Semesters: Enhanced 

Opening Doors Program 62 

5.4 Probation Status, First and Second Program Semesters: Enhanced 

Opening Doors Program 64 

vii 



A.l Selected Characteristics of Sample Members at Baseline: Opening Doors 

Program 79 

A. 2 Selected Characteristics of Sample Members at Baseline: Enhanced Opening 

Doors Program 82 

B. l Selected Characteristics of 12-Month Survey Respondents and 

Nonrespondents: Opening Doors Program 88 

B.2 Selected Characteristics of 12-Month Survey Respondents, by Research 

Group: Opening Doors Program 91 

B.3 Impacts on Registration, by Survey Respondents and Nonrespondents: 

Opening Doors Program 93 

D.l Transcript Outcomes, First Through Third Postprogram Semesters: 

Opening Doors Program 1 03 

D.2 Enrollment at Chaffey College and Other Institutions, Program Semester 

Through Third Postprogram Semester: Opening Doors Program 106 

D.3 Program Participation, by Gender: Opening Doors Program 108 

D.4 Transcript Outcomes, by Gender, Program Semester: Opening Doors Program 109 

D.5 Cumulative Outcomes, by Gender, Program Semester Through Third 

Postprogram Semester: Opening Doors Program 111 

D.6 Probation Status, by Gender, Program Semester Through Third Postprogram 

Semester: Opening Doors Program 113 

D.7 Program Participation, by Probation Status at Random Assignment: 

Opening Doors Program 115 

D.8 Transcript Outcomes, by Probation Status at Random Assignment, Program 

Semester: Opening Doors Program 116 

D.9 Cumulative Outcomes, by Probation Status at Random Assignment, Program 

Semester Through Third Postprogram Semester: Opening Doors Program 118 

D.10 Probation Status, by Probation Status at Random Assignment, Program 

Semester Through Third Postprogram Semester: Opening Doors Program 120 

D.l 1 Social, Psychological, and Health Measures of Sample Members at Baseline: 

Opening Doors Program 122 

D.12 Social and Psychological Outcomes: Opening Doors Program 123 

D.13 Health Outcomes: Opening Doors Program 125 

viii 



F.l Enrollment at Chaffey College and Other Institutions, First and Second 

Program Semesters: Enhanced Opening Doors Program 137 

F.2 Program Participation, by Gender, First and Second Program Semesters: 

Enhanced Opening Doors Program 138 

F.3 Transcript Outcomes, by Gender, First and Second Program Semesters: 

Enhanced Opening Doors Program 140 

F.4 Cumulative Outcomes, by Gender, First and Second Program Semesters: 

Enhanced Opening Doors Program 143 

F.5 Probation Status, by Gender, First and Second Program Semesters: Enhanced 

Opening Doors Program 145 

F.6 Program Participation, by Probation Status at Random Assignment, First and 

Second Program Semesters: Enhanced Opening Doors Program 146 

F.7 Transcript Outcomes, by Probation Status at Random Assignment, First and 

Second Program Semesters: E nh anced Opening Doors Program 148 

F.8 Cumulative Outcomes, by Probation Status at Random Assignment, First 

and Second Program Semesters: Enhanced Opening Doors Program 151 

F. 9 Probation Status, by Probation Status at Random Assignment, First and 

Second Program Semesters: E nh anced Opening Doors Program 153 

G. l Program Participation, First and Second Semesters: Opening Doors Program 

and Enhanced Opening Doors Program 157 

G.2 Transcript Outcomes, First and Second Semesters: Opening Doors Program 

and Enhanced Opening Doors Program 159 

G.3 Cumulative Outcomes, First and Second Semesters: Opening Doors Program 

and Enhanced Opening Doors Program 1 62 

G.4 Probation Status, First and Second Semesters: Opening Doors Program and 

Enhanced Opening Doors Program 1 64 



Figure 




ES.l 


Cumulative Credits Earned, First and Second Program Semesters: 
Enhanced Opening Doors Program 


ES-9 


ES.2 


Cumulative Grade Point Average, First and Second Program Semesters: 
Enhanced Opening Doors Program 


ES-10 



IX 



ES.3 Students Ever in Good Academic Standing, First and Second Program 

Semesters: E nh anced Opening Doors Program ES-1 1 

6. 1 Impact on College Success Course Registration, First Program Semester: 

Opening Doors Program and Enhanced Opening Doors Program 68 

6.2 Impact on Ever Visiting a Success Center, First Program Semester: Opening 

Doors Program and Enhanced Opening Doors Program 69 

6.3 Impact on Cumulative Credits Earned, First and Second Semesters: Opening 

Doors Program and E nh anced Opening Doors Program 70 

6.4 Impact on Grade Point Average of 2.0 or Higher, First and Second 

Semesters: Opening Doors Program and Enhanced Opening Doors Program 71 

6.5 Impact on Students Ever in Good Academic Standing, First and Second 
Semesters: Opening Doors Program and Enhanced Opening Doors Program 73 

Box 

1.1 “Bouncing Around” 8 

3. 1 Mixed Perceptions of the College Success Course 28 

3.2 Mixed Perceptions of the Success Centers 30 

3.3 How to Read the Impact Tables in This Report 39 

3.4 Mixed Perceptions of Opening Doors 43 



x 



Preface 



For many low-income individuals, four-year colleges are out of reach — not just finan- 
cially, but, just as important, academically. While community colleges have stepped into the 
breach and are seeing rising registration and enrollment rates, many students arrive at these 
schools underprepared for college- level work. In California, where the 1 10 community colleges 
located throughout the state have minimal entry requirements and the lowest tuition in the 
nation — meaning that virtually any resident who wants to attend college can do so — tens of 
thousands of students are on probation, owing to poor grades or inadequate academic progress, 
or both, and may not graduate. It is not enough, therefore, to help these students get into college; 
they need help staying there. 

Many higher education institutions around the country offer services to probationary 
students, such as targeted advising and counseling and study skills courses. But what kind of an 
impact do these services have? Do they help students get back into good academic standing so 
they can finish school and earn a degree or certificate? 

This report describes findings from a random assignment study of two versions of a 
program for students on probation at Chaffey College, a community college in Rancho Cuca- 
monga, approximately 40 miles east of Los Angeles. Both versions offered students a “College 
Success” course, taught by a college counselor, that helped probationary students understand 
college rules and regulations and develop better study skills. As part of the course, students 
were expected to visit the college’s “Success Centers,” where individualized or group instruc- 
tion in math, reading, and writing was available. 

The original version of the program, called “Opening Doors,” was voluntary and lasted 
one semester. The second version, called “Enhanced Opening Doors” in this report, sought to 
improve upon the first; it lasted two semesters, and the students were told they had to attend the 
course. While the original version of the program had no discernible impact on academic 
outcomes, Enhanced Opening Doors increased both the number of credits that students earned 
and their grade point averages, as well as the proportion of students moving off of probation. 

Given the documented positive relationship between attaining a postsecondary degree 
and higher earnings in the future, programs that might boost students’ chances of succeeding in 
community college deserve a close look. The Enhanced Opening Doors model described in this 
report is a promising example of one of those programs. 



Gordon Berlin 
President 
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Executive Summary 



Community colleges are often hailed as open-access institutions. Arguably, no state has 
done more to ensure access to community colleges than California. The state’s 1 10 community 
colleges have minimal entry requirements and the lowest tuition of any state in the nation. 1 
Unfortunately, recent analyses suggest that only one-fourth of students seeking a degree or 
certificate in California either transfer to a university or earn an associate’s degree within six 
years. 2 One reason for this low rate of college completion is that many students are underpre- 
pared for college-level work. In fact, tens of thousands of students in California are on proba- 
tion, owing to poor grades or inadequate academic progress, and face a high risk of not finishing 
school. Many colleges provide services to help probationary students succeed, but few studies 
have provided rigorous evidence on the effects of such services. 

As part of MDRC’s multisite Opening Doors demonstration, six community colleges 
across the country operated innovative programs to increase students’ academic achievement 
and persistence. Chaffey College, a large community college in Southern California, operated 
two versions of a program that was designed to improve outcomes among students on proba- 
tion. Referred to in this report as “Opening Doors,” which was the original version, and “En- 
hanced Opening Doors,” the programs offered a “College Success” course, taught by a college 
counselor, that provided instruction on topics designed to help students do well in school and 
get off probation. Students in the original Opening Doors program were encouraged to take the 
course, but it was voluntary. Students in the Enhanced Opening Doors program were told that 
they were required to take the course. As part of the course, students were expected to visit the 
college’s “Success Centers” — which were established at Chaffey in response to the college’s 
recognition that many of its students were not prepared for college-level work — where 
students could receive supplementary individualized or group instruction in math, reading, and 
writing. The one-semester Opening Doors program operated during fall 2005, and the two- 
semester Enhanced Opening Doors program operated during fall 2006 and spring 2007. 

This report discusses the programs’ implementation and their effects on students. To es- 
timate the effects of the original Opening Doors program, MDRC randomly assigned students 
either to a program group that was eligible for Opening Doors or to a control group that re- 



'California Postsecondary Education Commission, “Average Annual Undergraduate Tuition, Fees, Room, 
and Board Charged for Full-Time Students in Public, 2-Year, Degree-Granting Institutions, 2005-06,” 50 State 
Comparison — Postsecondary Education Data Graph: Average Annual Undergraduate Costs (State of 
California, 2009). Web site: www.cpec.ca.gov. 

2 Nancy Shulock and Colleen Moore, Rules of the Game: How State Policy’ Creates Barriers to Degree 
Completion and Impedes Student Success in the California Community’ Colleges (Sacramento: California State 
University, Institute for Higher Education Leadership & Policy, 2007). 
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ceived Chaffey’s standard college courses and services. Any subsequent substantial differences 
between the program and control groups’ academic outcomes can be attributed to the Opening 
Doors program. Although it was not part of MDRC’s original research plan, when Chaffey 
administrators decided to offer Enhanced Opening Doors — a revised version of the original 
program — MDRC and the college agreed that it warranted a separate evaluation, and they 
randomly assigned a second group of students to either a program or a control group. 

In summary, the key findings from this report are: 

• Chaffey’s original Opening Doors program did not meaningfully affect 
students’ academic outcomes. Program and control group members earned 
about the same number of credits and earned similar grades. Opening Doors 
did not help students get off probation. 

• In contrast, Chaffey’s Enhanced Opening Doors program improved 
students’ academic outcomes. It increased the average number of credits 
earned, the proportion of students who earned a grade point average (GPA) 
of 2.0 or higher, and the proportion who moved off probation. 

• Analyses suggest that the greater success of Enhanced Opening Doors 
might have been driven by the higher rate of participation in the College 
Success course. Approximately three-fourths of the Enhanced Opening 
Doors program group members took the course, compared with only about 
half of the Opening Doors program group members. 



How Were Chaffey’s Programs Developed? 

The histoiy of Chaffey’s Opening Doors program begins with its Basic Skills Transfor- 
mation Project. In 2000, concerned that more than 70 percent of its entering students were 
scoring at a pre-collegiate level on skills assessment tests, Chaffey used special funds from the 
State of California to establish math, reading, and writing Success Centers. Students in some 
developmental-level math and English classes were required to visit the centers; other students 
could visit on a voluntary basis. The centers, which provide one-on-one instruction, tutoring, 
workshops, and computer-based assistance, are led by a full-time faculty and are supported by 
other instructors and tutors. Students can make appointments or drop in, as the facilities are open 
early morning through evening on weekdays and some hours on weekends. The college’s 
Institutional Research office found that students who visited the Success Centers often had better 
academic outcomes than students who visited rarely or not at all, and that students on probation 
were the students least likely to use the Success Centers. 
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College administrators, meanwhile, were concerned with the growing number of stu- 
dents on probation. In spring 2004, approximately 3,500 students were on probation, or about 
one of every five students enrolled. At the time, probationary students typically received a letter 
from the college notifying them about their status and recommending that they meet with a 
college counselor. Like other students, probationary students could use the college’s supports, 
such as the Success Centers, but they were not required to do so. 

Building upon its experiences and drawing lessons from its data, Chaffey developed an 
innovative one-semester Opening Doors program model with three main components: a College 
Success course, which provided basic information on study skills and the requirements of 
college; visits to the Success Centers; and extra counseling. The primary goals of the program 
were to help students succeed in their classes and move off probation. With funding from The 
William and Flora Hewlett Foundation and The James Irvine Foundation, MDRC provided a 
grant to Chaffey College to develop and operate its original Opening Doors program. After 
Opening Doors ended, the college assessed the program and decided that student outcomes 
might be improved with some changes. As noted above, the next school year, Chaffey offered a 
revised version of the program, Enhanced Opening Doors. 



Whom Did the Programs Serve? 

Chaffey targeted students who were on academic or progress probation, had earned 
fewer than 35 credits, did not have an associate’s degree, had a high school diploma or General 
Educational Development (GED) certificate, and were 18 to 34 years of age. Students at 
Chaffey who have attempted 12 or more credits (since starting at Chaffey) are placed on 
academic probation if they have a cumulative GPA below 2.0 (“C”) and on progress probation 
if they have not successfully completed 50 percent or more of the credits they attempted. 

In 2005, 898 students were randomly assigned for the study of the original Opening 
Doors program, and, in 2006, 444 students were assigned for the study of the Enhanced Open- 
ing Doors program. Sixty percent of the Opening Doors and Enhanced Opening Doors sample 
members are women. Fifty-three percent identified themselves as Hispanic/Latino, 23 percent 
as white, and 14 percent as black (non-Hispanic). Most sample members were between 18 and 
20 years of age when they were randomly assigned. Most were unmarried and did not have any 
children. Approximately half of the sample members said they were financially dependent on 
their parents when they entered the study. 



How Were the Impacts of the Programs Evaluated? 

As noted above, MDRC assigned students, at random, to either a program group or to a 
control group to estimate the effect, or “impact,” of Chaffey’s original Opening Doors program. 
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The study is tracking the Opening Doors program group and control group over time to estimate 
whether Chaffey’s original program resulted in better outcomes for students compared with 
standard classes and services. Random assignment ensures that the characteristics, including 
motivation levels and demographic characteristics, of students in the program group and control 
group are similar when a study begins; hence, any subsequent substantial differences in out- 
comes can be attributed to the program. Using the same rigorous research design, MDRC 
randomly assigned a second group of students to estimate the effects of Enhanced Opening 
Doors compared with standard classes and services, and is tracking their outcomes. The study, 
therefore, is estimating the value added of Opening Doors and Enhanced Opening Doors, above 
and beyond what probationary students normally would have received at Chaffey during the 
study period. The study also allows for a direct comparison of the effects of the two programs in 
which most circumstances were similar except for the variations in the two programs, and offers 
suggestive evidence about why those effects might differ. 

It is important to note two limitations of the study. First, in temis of a program-to- 
program comparison, because Opening Doors and Enhanced Opening Doors were operated 
sequentially, not simultaneously, MDRC is not able to definitively attribute any differences in the 
programs’ impacts to the programs themselves. (To do so would have required that students be 
randomly assigned to one of the two programs or to the control group, which was not possible.) 
Second, the study cannot disentangle the effects of each program component (such as the effects 
of the College Success course separate from the effects of asking students to visit the Success 
Centers). Rather, the study examines whether the package of reforms in Opening Doors and 
Enhanced Opening Doors led to different outcomes compared with standard classes and services. 



Opening Doors: How Was It Implemented and Did It Make a 
Difference for Students? 

Table ES.l describes the key components of the original Opening Doors program, the 
Enhanced Opening Doors program, and the standard college services and courses that were 
available to the study’s two control groups. Chaffey’s original program, Opening Doors, offered 
a College Success course. The course was the central component of the Opening Doors pro- 
gram; program group students who did not take the course did not receive any Opening Doors 
services. The college encouraged Opening Doors program group members to take the College 
Success course, but it did not require that they do so. 

The College Success course provided instruction on how to set personal goals, manage 
time, study effectively, understand college rules and regulations, and other topics designed to 
help students do well in school. It used On Course, a curriculum developed to promote “innova- 
tive learner-centered strategies for empowering students to become active, responsible 
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SOURCE: MDRC field research data. 



learners.” 3 The course’s three credits counted toward full-time enrollment at the college, but 
they could not be applied toward a degree or transferred to another postsecondary institution. 

The program model specified that, as part of the College Success course, students 
would be asked to visit the college’s Success Centers nine times during the semester. Based on 
the results of skills assessment tests, students would be asked to complete a series of assign- 
ments at the Success Centers to improve their math, reading, or writing skills. The assignments 
counted toward a student’s grade for the College Success course. The program model also 
specified that the instructor of the College Success course provide extra counseling to participat- 
ing students, both inside and outside of class. 

The key findings about the original Opening Doors program as it was implemented at 
Chaffey College follow. 

• Chaffey’s Opening Doors program did not fully operate as designed and 
participation rates were lower than the college and MDRC had hoped. 

Only about half of the Opening Doors program group took the College Success course; 
thus, the program did not reach many of the students it was designed to serve. Low participation 
rates likely reflect the interaction of the program’s voluntary nature and the fact that the College 
Success course did not provide transferable credits and therefore may not have been as attrac- 
tive to students as some other courses. 

Some of the course instructors did not communicate and enforce the course expectation 
of visiting the Success Centers nine times. Many Chaffey students visit the centers on their own 
or as part of a developmental course, and, in the end, the program did not increase attendance at 
the centers as much as expected. In addition, some students in the Opening Doors program 
received extra counseling from their instructor, but many did not. 

• Opening Doors did not meaningfully improve students’ academic out- 
comes. 

MDRC compared academic outcomes for the Opening Doors program and control 
groups to estimate the impact of the program. Tests of statistical significance were conducted to 
determine whether any differences that emerged were likely to be a result of chance rather than 
the program. (Differences, or effects, that are not statistically significant may be a result of 
chance.) The analyses show that Opening Doors did not have a statistically significant effect on 
the total number of credits that students earned or on their GPA. Furthermore, Opening Doors 
did not have a statistically significant effect on moving students off probation. 



Tor more information, see www.oncourseworkshop.com. 
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Enhanced Opening Doors: How Was It Implemented and Did It 
Make a Difference for Students? 



As shown in Table ES.l, the first semester of Enhanced Opening Doors offered the 
same components as the original Opening Doors program, but had some key differences. 
Chaffey administrators were disappointed in the low rate of participation in the original pro- 
gram, and decided to require participation in the Enhanced Opening Doors program. Thus, 
Enhanced Opening Doors program group members were told that they were required to take the 
College Success course and that their registration would be blocked if they did not. In the end, 
administrators decided not to implement the block. Interviews with Enhanced Opening Doors 
program group students, however, indicated that most believed that they were, in fact, required 
to take the course, based on the messages they had heard during and after study intake. 

The College Success course for Enhanced Opening Doors was taught by staff with ex- 
perience in the original Opening Doors program. The Success Center component of the pro- 
gram was reduced to five expected visits from nine, and the assignments were integrated with 
themes from the College Success course, rather than being based upon students’ assessment 
results. Enhanced Opening Doors offered a second College Success course in the second 
semester of the program to build upon what students learned in the first semester. 

The key findings about the Enhanced Opening Doors program implemented at Chaf- 
fey College follow. 

• Chaffey’s Enhanced Opening Doors program operated largely as de- 
signed and participation rates were relatively high. 

Approximately three-fourths of the Enhanced Opening Doors program group took the 
first-semester College Success course. Approximately one-third of the program group took the 
second-semester College Success course. As was the case in the original Opening Doors 
program, program group members who did not take the College Success course in the En- 
hanced Opening Doors program did not receive any program services. 

All the College Success course instructors in Enhanced Opening Doors enforced the ex- 
pectation that students visit the Success Centers five times during the semester. During the first 
semester of the program, the proportion of Enhanced Opening Doors program group members 
who visited a center at least once was more than double the proportion of Enhanced Opening 
Doors control group members. Finally, the Enhanced Opening Doors program consistently 
provided extra counseling to students who took the College Success courses each semester. 
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• Enhanced Opening Doors increased the number of credits that students 
earned. 

Figure ES. 1 shows the number of credits that students earned in their first two semesters 
in the study (the “program semesters”)- The white bar in the figure shows the average number of 
credits earned by the Enhanced Opening Doors program group, and the solid bar shows the 
average outcome for the Enhanced Opening Doors control group. The difference between the two 
groups’ average outcomes is the estimated impact of the program. Asterisks above the bar indicate 
that the impact is statistically significant, meaning that it is unlikely to be a result of chance. 

As shown, the Enhanced Opening Doors program group earned an average of 8.3 credits 
during their first two semesters in the study, compared with an average of 5.6 credits for their 
control group counterparts. Almost all the estimated increase of 2.7 credits is accounted for by 
credits that do not count toward a degree (primarily from the College Success course). 

• Enhanced Opening Doors increased the proportion of students who 
earned a cumulative GPA of 2.0 or higher. 

Figure ES.2 (see page ES-10) illustrates the estimated program impact on GPA over the 
two semesters after sample members entered the study. The first two bars show the program 
group and control group average for the “cumulative GPA,” which includes all credit-bearing 
courses and is the GPA used at Chaffey to determine students’ probationary status. (Recall that 
students who have attempted 12 or more credits are placed on academic probation if their 
cumulative GPA drops below 2.0, and they are placed on progress probation if they do not 
successfully complete at least half of all credits attempted.) As the figure shows, 36.2 percent of 
the Enhanced Opening Doors program group earned a cumulative GPA of 2.0 (“C”) or higher, 
compared with only 23.6 percent of their control group counterparts. 

The higher cumulative GPA for the program group is partly a result of the grades that 
they received in the College Success course. The second set of bars in Figure ES.2 shows 
outcomes for the “degree-applicable GPA,” which excludes grades from the College Success 
course and other courses that do not count toward a degree (such as other college preparatory 
courses). As the figure shows, Enhanced Opening Doors also increased the proportion of 
sample members who earned a cumulative degree-applicable GPA of 2.0 or higher. This 
finding suggests that Enhanced Opening Doors positively affected perfonnance in courses 
outside the program. 

• The Enhanced Opening Doors program almost doubled the proportion 
of students who moved off probation and into good academic standing. 

Given the impact on GPA described above, it is not surprising that Enhanced Opening 
Doors moved many students off probation. As shown in Figure ES.3 (see page ES-11), 30.4 
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